Believing in POMDPs
نویسندگان
چکیده
Partially observable Markov decision processes (POMDP) are well-suited for realizing sequential decision making capabilities that respect uncertainty in Companion systems that are to naturally interact with and assist human users. Unfortunately, their complexity prohibits modeling the entire Companion system as a POMDP. We therefore propose an approach that makes use of abstraction to enable employing POMDPs in Companion systems and discuss challenges for applying it.
منابع مشابه
The correlation between believing in resurrection and attitudes toward death among elderly people
Background & Objectives: Since believing in resurrection and life after death exists in all religions, streng thening this belief leads to positive emotional states, increases adaptation to adverse life events, reduces the fear of death and gives a meaning to life. Therefore, this study was conducted to investigate the correlation between belief in the hereafter and the attitude of death in the...
متن کاملRegion-Based Approximations for Planning in Stochastic Domains
This paper is concerned with planning in stochastic domains by means of par tially observable Markov decision processes (POMDPs). POMDPs are difficult to solve. This paper identifies a subclass of POMDPs called region observable POMDPs, which are easier to solve and can be used to approxi mate general POMDPs to arbitrary accuracy.
متن کاملFully-Nested Interactive POMDPs for Partially-Observable Turn-Based Games
Interactive POMDPs (I-POMDPs) are a useful framework for describing POMDPs that interact with other POMDPs. I-POMDPs are solved recursively in levels: a level1 I-POMDP assumes the opponent acts randomly, and a levelk I-POMDP assumes the opponent is a level-(k-1) I-POMDP. In this paper, we introduce fully-nested I-POMDPs, which are uncertain about the physical state of the game, the level of the...
متن کاملDeterministic POMDPs Revisited
We study a subclass of POMDPs, called Deterministic POMDPs, that is characterized by deterministic actions and observations. These models do not provide the same generality of POMDPs yet they capture a number of interesting and challenging problems, and permit more efficient algorithms. Indeed, some of the recent work in planning is built around such assumptions mainly by the quest of amenable ...
متن کاملQuasi-Deterministic Partially Observable Markov Decision Processes
We study a subclass of POMDPs, called quasi-deterministic POMDPs (QDET-POMDPs), characterized by deterministic actions and stochastic observations. While this framework does not model the same general problems as POMDPs, they still capture a number of interesting and challenging problems and, in some cases, have interesting properties. By studying the observability available in this subclass, w...
متن کامل